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(54) Virtual control system using non-imaging scanners 



(57) A user operated virtual control system based 
on Identification and spatial tracking of tags distributed 
in a room comprises a laser base station for scannin la- 
ser beams, multiple tags reactive to incident laser 
beams to provide a data signal, and a tag tracking sys- 



tem receiving input from the laser base station, the tag 
tracking system providing a control signal in response 
to user defined location changes in at least one of the 
multiple tags. Furthermore, a user operated method for 
virtually controlling of systems. 
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Description 

FIELD OF THE INVENTION 

[0001 ] The present invention reiates to laser scanning 
systems for tracking relationships between light reflec- 
tive or emissive tags. More particularly, the present In- 
vention reiates non-imaging systems for identifying vir- 
tual controls based on interrelationships between tag 
positions. 

[0002] Tagging objects to aid In identification, security, 
and organization Is widely employed by businesses. 
Passive tag systems include conventional bar code 
tags, microwave detectable tags, or tags marl<ed with 
computer readable alphanumerics. However, all of 
these tagging solutions generally require close proxim- 
ity between the tag and the tag reader, typically less than 
a meter. For applications where tags need to be identi- 
fied In a 1 to 5 meter range, active tags that have on- 
board power to broadcast radio or infrared pulses can 
be used. For example, a battery powered Infrared tag 
utilizing IrDA pulse modulation can be constructed to 
emit an identification pulse sequence every 10 to 15 
seconds, and can have a lifetime on the order of a year. 
However, since such active devices are costly, generally 
have a high power cost, and can require expensive bat- 
tery or photovoltaic power systems, they are unsuitable 
for applications requiring hundreds or even thousands 
of tags. 

[0003] Conventional passive (e.g. optically readable 
bar codes) or active (e.g. infrared emissive) tags can 
also be difficult to find or detennlne exact position in a 
room sized area, imaging detectors such as camera 
systems are costly, and can require substantial comput- 
ing power to extract data signals from a tag and deter- 
mine three-dimensional position of the tag. 
[0004] What is needed is a tagging system that can 
be easily read from a distance with augmented portable 
computing devices such as handheld or palm-sized 
computers, or automatically detennlned (without user 
assistance) using a non-imaging room scanning sys- 
tem. 

[0005] To meet the above demand in accordance with 
the present invention, a virtual control system having the 
features defined in claim 1 and a method having the fea- 
tures defined in claim 6 are provided. 
[0006] Such tagging systems can support local com- 
munication between nearby computers, or more gener- 
ally can support wireless network or internetwork com- 
munications relating to data signals from the tags. Users 
equipped with suitable portable computers can, for ex- 
ample, receive identifying information from local tags, 
and be connected to an updateable networked data- 
base that stores position state, identifying information 
concerning the tagged object, and a record of previous 
state changes for the tag. As will be appreciated, flexi- 
bility and utility of various applications can be enhanced 
If the precise spatial location of the tagged objects 



known. Knowing the location of the tag (with a precision 
of several meters or so) permits construction of user 
specific maps, transfer of location information to others, 
and receipt of location Infonmation for nearby computa- 
5 tional or real world resources. For this reason, having 
easily detemninabie and reliable position Infomnation Is 
a useful feature. 

[0007] Improved information dissemination and or- 
ganization for Individuals or organizations is enhanced 
with a stable and reliable mechanism for tracking and 
locating multiple tagged objects In conventional room or 
office sized areas. Tagged objects can be assembled, 
manipulated, and maintained to create, alter, preserve, 
share, or coordinate infomnation. For example, wall 
mounted pin boards or magnetic boards can be used by 
an individual or group to transiently or seml-pemrianently 
display documents, calendars, task schedules, phone 
number lists, project proposals, informational flyers, 
meeting announcements, photographs, maps, or any 
other desired information. In some cases, small physical 
artifacts such as keys or magnetic icons can even be 
attached to the surface. 

[0008] Accordingly, in preferred embodiments the 
present invention includes a laser locating and tracking 
system for externally activated electronic tags. Such a 
non-Imaging system can precisely locate and identifying 
tagged objects in a confined space such as a room or 
office. The system includes at least one laser base sta- 
tion for scanning laser beams, and supports identifica- 
tion and spatial positioning of multiple tags reactive to 
incident laser beams to provide a data signal. A tag 
tracking system receives input from the laser base sta- 
tion, with the tag tracking system storing state records 
of position and Informational content of the tag. Position 
can be optionally detennined by angular position of the 
tag with respect to one or more the laser base stations. 
The tags are passive (with no internal power), or active, 
having an internal power supply to power a data broad- 
cast element. 

[0009] An externally light activated, low power active 
electronic tag is particular useful in conjunction with the 
present invention. Such low power electronic tags and 
tag tracking systems can use infrared or radiofrequency 
tags having identification circuits externally triggered by 
a directed light pulse. Such tags generally have an in- 
ternal power supply (e.g. battery), a data broadcast el- 
ement controlled by a microcontroller and powered by 
the internal power supply, and a laser beam trigger cir- 
cuit activated by an Incident laser beam to trigger data 
broadcast by the data broadcast element. The data 
broadcast can be optical, infrared, radio, or even acous- 
tic signals. A prefen^ed data broadcast standard is based 
on the connectionless IrDA protocol pulse modulated in- 
frared data signals. Such signals can be detected by 
conventional infrared transceivers commonly deployed 
with portable, laptop, or palmtop computers. The tags 
can be readily activated by a low power laser attached 
to a palmtop computer, for example, allowing a user to 
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specify tag activation from a distance. Alternatively, au- 
tomatic laser scanning systems can be used to contin* 
uously and automatically track tag positions. 
[001 0] For some applications the foregoing externally 
activated tags are not Ideal, since they still require a bat- 
tery, have a relatively large form factor, and can be 
somewhat expensive. For applications requiring very 
large numbers of Identification tags, a barcode-like sys- 
tem readable from a distance (1 to 5 meters) is pre- 
ferred. Accordingly, another preferred embodiment of 
the present Invention provides for pattemed retroreflec- 
tlve tags usable in laser scanning systems. Typically, 
such patterned retro reflective tags are muttllayered, and 
the tags can have fixed or dynamically changeable laser 
readable regions. Typically, a tag identification system 
would include a tag having retroreflective substrate for 
reflecting incident light beams, and pattemed Indicia for 
selectively reducing retroreflectivity of the retroreflective 
substrate. A portable (handheld) or fixed laser beam 
base station connected to a computer can read the tag 
and associate the read tag with Information, Including 
data or commands for computer control. 
[0011] In preferred embodiments, the patterned Indi- 
cia of the tag are formed by selectively destroying por- 
tions of the retroreflective substrate. Alternatively, the 
pattemed Indicia are formed by selectively obscuring 
portions of the retroreflective substrate through surface 
printing, coating, or other suitable techniques. In multi- 
layer embodiments, a printable and substantially trans- 
parent masking layer covering the retroreflective sub- 
strate can be used for printing. In still other embodi- 
ments that add some active elements to the passive tag, 
an electrically modifiable region (e.g. LCD, electrochro- 
mic material, or other conventional low power, electri- 
cally opaqueable material) can be used to selectively 
obscure portions of the retroreflective substrate. Typi- 
cally, the opaqued or obscured regions are patterned as 
a series of stripe emulating conventional bar codes, al- 
though other coding patterns can of course be used. 
[0012] Still another preferred embodiment of the 
present invention using the foregoing passive, active, or 
combination active/passive tags provides for a virtual 
control system using non-imaging scanners (e.g. laser 
scanning systems) by tracking relationships between 
light reflective or emissive tags. Advantageously, such 
a non-imaging system can identify virtual controls based 
on Interrelationships between light reflective or emissive 
tag positions. Typically, a user operated virtual control 
system involves scanning laser beams throughout a 
room using a laser base station and detecting data sig- 
nals produced by multiple tags reactive to incident laser 
beams scanned throughout a room. By tracking posi- 
tional changes of multiple tags, the positional semantics 
of the tag can be recognized and allow provision of a 
control signal in response to user defined location 
changes in at least one of the multiple tags. Positional 
changes in tag position can be relatively determined (e. 
g. with one laser base station) or absolute three dimen- 



sional position changes can be determined (e.g. with 
two or more laser base station, or other position detect- 
ing mechanisms such an antenna grid array responsive 
to radio signals. In a most prefen'ed embodiment, pas- 

5 sive retroreflectors are employed. 

[0013] In certain embodiments of the present inven- 
tion, electromagnetic induction activated electronic tags 
can be used for tag activation or location. Such radlof- 
requency tags are externally triggered by a directed 

10 electromagneticpuise(e.g. from a microradar or narrow 
beam microwave source) or optical pulse (laser or infra- 
red), and spatial tracking can involve separate electro- 
magnetic tracking systems or laser scanning systems 
such as previously discussed. 

15 [0014] One preferred embodiment of an electromag- 
netic tracking system suitable for use In conjunction with 
electronic tags has an embeddable antenna array for 
activation and localization of electronic tags. These tags 
can optionally be externally triggered by a directed elec- 

20 tromagnetic pulse delivered through the antenna grid ar- 
ray, or triggered by an extemal light or electromagnetic 
source, with spatial-location being determined with the 
aid of the antenna grid array. 

[0015] Additional functions, objects, advantages, and 
25 features of the present invention will become apparent 
from consideration of the following description and 
drawings of preferred embodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

[0016] 

Figure 1 schematically illustrates a tag tracking sys- 
tem supporting non-imaging laser tracking, as well 
35 as electromagnetic tracking and triggering using 
embedded antenna arrays, with specific triggering 
of electronic tags using a user (not shown) operable 
portable computer; 

Figure 2 schematically illustrates an optical trigger 

40 circuit for an infrared tag; 

Figure 3 schematically illustrates various trigger 
and output circuits suitable for use in conjunction 
with tags according to the present invention; 
Figure 4 illustrates a non-imaging laser scanning 

45 system; 

Figure 5 illustrates a patterned retroreflective tag for 
use in conjunction with a non-imaging scanning la- 
ser system; 

Figure 6 illustrates a dual layered patterned retro- 
50 reflective tag for use in conjunction with a non-im- 
aging scanning laser system; 
Figure 7 illustrates a dual layered patterned retro- 
reflective tag with a readily reconfigurable LCD pat- 
tern region for use in conjunction with a non-imag- 
55 ing scanning laser system; 

Figure 8 illustrates a possible virtual control system 
using retroreflective tag and non-imaging scanning 
laser system; and 
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Figure 9 Illustrates another possible virtual control 
system using retroreflective tag and non-imaging 
scanning laser systenn. 

DETAILED DESCRIPTION OF THE DRAWINGS 

[0017] As seen in Figure 1 , a system 1 0 for identifica- 
tion and tracking of tags distributed In a room can in- 
clude various mechanisms for spatial localization of nor- 
mally passive, nomially active, or triggerable tags. Bo- 
cause of low cost, use of Infrared or radl of requency elec- 
tronic tags having a semiconductor memory for data 
storage, processing logic, and a small IR diode/antenna 
for broadcasting data, ail embedded in rugged epoxy, 
themnoptastic, or other suitable plastic containers, Is 
prefen-ed. Data storage capacity for such electronic tags 
typically ranges from a few bits to many l<ilobits, with 64 
bits being typical. Tags can include read only memory 
(ROM), electrically programmable or erasable (EPROM 
and EEPROM), or flash memory. An electronic tag can 
be powered by a long lasting small battery, photovoltaic 
power, themnal converter, inductive power converter 
that relies on externally applied electromagnetic energy, 
or any other suitable power supply. In certain embodi- 
ments, tags can even provide user feedback to confirm 
activation of the electronic tag. User feedback can be 
visual (e.g. blinking or turning on an LEO status light, 
text based or iconic display presentations), auditory (e. 
g. an audible buzz or beep), tactile (e.g. a button being 
raised or a perceptible structure rotation), or combina- 
tions of the foregoing. 

[0018] Tags can be deployed anywhere in a room. 
Suitable room surfaces capable of retaining objects can 
include but are not limited to conventional walls, ceil- 
ings, floors, pin-boards, writeable chalkboards or porce- 
lain boards, desktops, tabletops, or even hanging tap- 
estries. For example, tags permanently or temporarily 
positioned on a desktop, a wall adjacent to the desktop, 
or a file drawer can be detected. In other embodiments, 
a single wall mounted pin-board capable of holding 
tagged pin or clip attached objects can be used. This 
latter embodiment is particularly useful for use in con- 
junction with a single base station, since angular infor- 
mation alone can be used to spatially discriminate be- 
tween tags. In certain embodiments particularly suitable 
for security monitoring, tags can be embedded in ob- 
jects or otherwise not visually apparent. 
[0019] In operation, tags can be premarked with suit- 
able graphical, symboiic, or textual indicia. In addition, 
the tag can be shape or texturally coded for ease of rec- 
ognition. For example, an electronic tag shaped as a 
cube or a rectangular solid with identifiable texturing can 
be color coded or marked with text. Physical objects or 
artifacts suitable for tagging with passive tags are typi- 
cally documents, including but not limited to paper 
based textual documents, small electronic display 
screens, or textual material. Physical artifacts may also 
include wall mounted containers having signaling lights, 



or attachable symbolic Icons. As will be appreciated, 
physical artifacts that can be tagged with suitable tags 
also Include the various documents, notecards, calen- 
dars, task schedules, phone number lists, project pro- 
5 posals, infonnational flyers, meeting announcements, 
photographs, maps, keys, or magnetic Icons commonly 
used to organize or disseminate infon-nation for individ- 
uals or groups. 

[0020] To activate, identify, and spatially locate the 

10 foregoing tags, various systems and sensing modes can 
be employed, alone or in conjunction with each other. 
For example, Figure 1 illustrates a scanning unit 20 
(base station) that optionally supports comprehensive 
scanning of a room using laser module 26, microwave 

15 module 28 (including radar or other beamed ranging or 
non-ranging electromagnetics), or acoustic module 27 
(including ultrasonic or other beamed ranging or non- 
ranging acoustic pressure waves). The modules can be 
glmbal 22 mounted for physical scanning of the room, 

20 or other suitable scanning mechanisms can be em- 
ployed, including use of movable mirrors, diffraction 
gratings, phase an^ay techniques or any other conven- 
tional mechanism for scanning a narrow beam at a 
known angle (with respect to a suitable coordinate sys- 

25 tern) through a room. As will be appreciated, multiple 
widely separated scanning units can be used to provide 
complete room coverage. Overlap of scanned regions 
by multiple scanning units further allows three-dimen- 
sional positioning when using non-ranging beams. For 

30 example, by coordinating angular positioning Informa- 
tion from laser beams directed from scanning units 20 
and 24 to be incident of a document tagged with a 
unique laser beam reflective tag, the system 1 0 can spa- 
tially localize the tag In a room. As those skilled in the 

35 art will appreciate, for certain applications only angular 
information from a single scanning unit may be required 
to spatially separate tagged objects (e.g. when scanning 
a single wall surface, or when using phase array anten- 
na that permits multiple portions of the array to directing 

40 multiple beams at a differing angles, providing limited 
trianguiation for nearby microwave tags). For more gen- 
eral applications, multiple scanning modules integrated 
to share infomriation or communicate with a common 
computing systems are prefen-ed. 

45 [0021] In certain embodiments, the high precision 
(centimeter scale localization) possible with pemnanent- 
ly fixed scanning units is not required. Simple spatially 
localized tag activation, or relative positioning, may be 
all that Is need. In such cases, a portable, handheld 

50 computer 12 optionally equipped with one or more op- 
tical, electromagnetic, or acoustic beam modules can 
be used. For example, an laser 14, ultrasonic signal 
generator, or radio detector/directional antenna 17 can 
be used to project a user scannable beam that triggers, 

55 reads, activates, or othenwise Interacts with tags having 
a unique identification. Depending on the beam and type 
of tag. various detectors 16 (optical, infrared, radio, 
acoustic) attached to computer 1 2 can be used to de- 
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termine tag Identity and possibly provide relative or low 
precision spatial localization. 

[0022] in stiil other embodiments of the present Inven- 
tion, spatial localization can be provided without any ex- 
plicit detennination of beam angle. For example, a tag 
54 reactive to any Incident laser, electromagnetic, or 
acoustic beams can provide a radio data signal. This 
radio data signal can be detected by an embedded an- 
tenna grid 40 positioned adjacent to the tag in a wall- 
board, chall<board, or other suitable material. Using a 
signal receiver connected to orthogonal lines 42 (X-axIs) 
and lines 43 (Y-axis), the x-y positional coordinates 
based on maximal signal strength can be used to deter- 
mine position of the broadcasting tag. Identity of a tag 
is detemnined by broadcast of a suitable identifying 
pulse, amplitude, or frequency modulated data Identifier 
using conventional wireless protocots. 
[0023] Whatever the spatial detection mechanism or 
particular protocol used, in operation the system 10 typ- 
ically has a networked computer 30 (optionally support- 
ing Input module 30 tor receiving optical, Infrared, radio, 
or acoustic signals, as well as signals received through 
conventional serial, parallel, USB or other Input port) 
supporting a software based tag tracking system tor re- 
ceiving input from the laser base station and the radio 
receiver. The tag tracking system stores state records 
of position and informational content of the tag. 
[0024] In operation, as seen in Figure 1, documents 
50 or 52, or objects 54 can be tagged to allow for ready 
manipulation of documents or artifacts through addition, 
removal, replacement, reordering, or stacking. For ex- 
ample, a team's project schedule might be represented 
on a wall mounted pin board by pin attached task cards 
arranged in a timeline format. Such task cards can be 
easily altered or physically moved with respect to a dis- 
played timeline as people leave a project, schedules 
slip, or any other problems develop. While tagged ob- 
jects are often documents, they may alternatively be 
physical icons, or other small physical artifacts attacha- 
ble by magnets, pins, adheslves, frictional forces, or oth- 
er conventional attachment mechanisms, informational 
content of at least some of the plurality of tagged com- 
ponents can be directly detemnined by transfer/reading 
of Information (which may be either an address to an 
electronic document, or the document information itself) 
from a tag, or determined by position based associa- 
tions maintained by a computer based tracking system. 
[0025] In preferred embodiments, the tracking system 
provides a database with information necessary for con- 
structing a senes of time dependent snapshots of posi- 
tion and infomiational content. This database is update- 
able to reflect changes in position andinfonnational con- 
tent, while still retaining a time/action addressable 
record of state changes of the plurality of microwave 
tagged objects. This allows, for example, a user to dig- 
itally replay changes in a tagged object collection, or de- 
termine the state of tagged objects a day, a week, or a 
month earlier. 



[0026] Advantageously, In conjunction with appropri- 
ate identification, location, user input, and user output 
systems, the system 1 0 can be used to determine iden- 
tity of text or graphics on documents printed on physical 

5 media and removably attached to a surface, associating 
them with electronic documents accessible through net- 
worked computer. Other general applications Include 
sensing the location of tagged documents or other phys- 
ical artifacts, either In absolute coordinates or relative 

10 (e.g. anguiar differentiation) to a base station or other 
tagged documents. More advanced tracking systems 
can be used to perfomn useful operations based on 
sensed actions performed by users of the system 10, 
including, for example, modifications to databases 

15 based on location changes of tagged documents. 

[0027] Figure 2 shows one suitable low powered, light 
based trigger suitable for use in conjunction with a sys- 
tem 1 0 such as illustrated in Figure 1 . As seen in Figure 
2, a circuit 60 (based on Philips BRY39 or BRY62 sur- 

20 face mount package) supports an IR element 64 for data 
broadcast. Data Is stored In microcontroller 66, and the 
circuit 60 is triggered to broadcast data by light hitting 
an LDR 62, which in turn triggers a silicon controlled 
switch. Data can be broadcast using conventional IrDA 

25 standard for receipt and processing by a user's portable 
computer or other suitable Infrared receiver/detection 
system. 

[0028] In operation, an intense light source such as a 
user pointed laser, or an automatically scannable laser 
30 such as discussed in connection with Figure 1 , is used 
to interrogate the circuit 60. IHand holdable red lasers 
are particularly preferred because of their ability to cre- 
ate a user viewable dot almable at a specific tag sup- 
porting low power trigger circuit 60. iHand holdable la- 
ss sens are compact, have a long battery life , and are wide- 
ly available. Conventional hand holdable lasers can 
easily project a target dot having suitable intensity and 
size to as much as 50 feet from a user, making them 
ideal for pointing and triggering devices In accordance 
40 with the present invention. 

[0029] After a user (or automatic computer controlled 
scanning laser) directs a beam against LDR 60, the re- 
sistance of the LDR rapidly drops below a critical thresh- 
old to trigger a silicon-controlled switch. Nomnaily, an 
45 LDR changes its resistance based on light falling on its 
surface, with maximal resistance for the LDR being on 
the order of 10 M Ohms in a dark room and 10 k Ohms 
in a brightly-lit room. To adjust for room lighting condi- 
tions, a resistor or preset is place In series to control 
50 resistance values. This allows selective user adjustment 
of resistance values to artificially create a brighter con- 
dition than nonnal ambient lighting to cause the silicon- 
controlled switch to switch on. The output of the silicon- 
controlled switch is used to provide a reset signal to the 
55 microcontroller 66. Because the silicon controlled switch 
and microcontroller typically draw less than 10 micro- 
amps in a quiescent state, battery lite for the circuit is 
enhanced, and support for large numbers of such bat- 
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tery-powered devices becomes feasible. 
[0030] Alternative trigger modes and broadcast out- 
put modes usable in accordance with the present inven- 
tion are schematically illustrated In Figure 3. As seen in 
Figure 3 a tag system 70 can optionally be triggered by 
various trigger mechanisms 72, including optical/infra- 
red input (box 80), radiofrequency. electromagnetic or 
beamed microwave input (box 62), or acoustic/beamed 
ultrasonic input (box 84). Broadcast/output mechanisms 
76 can similarly include optical/infrared output (box 80), 
radiofrequency, electromagnetic or microwave output 
(box 92), or acoustic/ultrasonic input (box 94). Broad- 
cast data is determined by a pulse train from microcon- 
troller/data storage element 86. 

[0031] To allow for low power operation, trigger circuit 
74 Is used to wake the microcontroller/data storage el- 
ement 86 and broadcast/output mechanisms 76 from a 
normally quiescent, low power state that extends battery 
life. In preferred embodiments, the trigger circuit 74 uses 
a l\/laxim MAX837, l\/IAX931, or equivalent that com- 
pares trigger Input voltage level (e.g. light level) with a 
fixed reference voltage that provides a logic switching 
threshold. Supply voltage can range from 2.5 V to 11 V, 
with a supply current of several microamps at 11 V. 
[0032] Figure 4 schematically illustrates a preferred 
laser light triggered system 100 for those embodiments . 
of the invention requiring automatic scanning to locate 
or trigger tags. Particutariy suitable for use in conjunc- 
tion with passive retro reflective tags, the system 100 in- 
cludes a laser 101 (typically near infrared, but visually 
perceptible laser wavelengths can be used), and a 
beam splitter 103. Typically, laser power is on the order 
of a few mW, and beam splitter 1 03 signal loss is on the 
orders decibels, in certain embodiments, low loss op- 
tical circulators can be substituted for beam splitter 1 03. 
[0033] In operation, laser 101 produces an outgoing 
beam directed along beam path 102 at beam splitter 
103. The beam splitter 103 deflects half of the beam to 
follow beam path 1 06 and passes the other half along 
beam path 1 04 into a light absorber 1 05. The beam mov- 
ing along beam path 1 06 reflects off a movable scanning 
mirror 107. which is rotated by motor 108 and rotary 
mechanism 109 to sweep the beam around a room in a 
two or three dimensional sweep pattem. The reflected 
beam follows beam path 111 to strike a retro reflective 
tag 110, and returns along beam path 111 and 106 to 
beamsplitter 1 03. A portion of the beam passes through 
the beam splitter 103 to a PIN diode 114 and amplifier 
115, pennitting detection of a returned beam. If the 
beam returned has a recognizable data pattern, further 
processing can occur to determine position and object 
tracking and identification. 

[0034] One embodiment of the invention particulariy 
suitable for use in conjunction with the system of Figure 
4 is schematically illustrated by Figure 5. A passive tag 
120 is constructed from a high gain retroreflective ma- 
terial 122. Suitable retroreflective tag material includes, 
but Is not limited to, "Reflexite", a trademarked term of 



3M Corp. that Is fonned as a monolayer of half silvered 
glass spheres carried on a flexible elastomeric sub- 
strate. Alternatively, 3I\^ Corporations "Special Effects 
Projection Screen 7610" can be used. These materials 

s have a high degree of retro reflectivity, with incident light 
returned largely along its incident path with very little di- 
vergence. For example, the "7610" material has a half 
power included angle of less than 1 degree, and an on- 
axls response 1 600 times greater than a conventional 

10 white d iff user. 

[0035] As seen in Figure 5, parallel grooves 124 are 
inscribed in the retroreflective material 122 of passive 
tag 120, removing the half silvered glass spheres, cor- 
ner reflectors, or other suitable high retro reflection ma- 

15 terial.This results in highly retroreflective lands 126 sep- 
arated by minimally reflective grooves 124. If the inscrib- 
ing is done to emulate conventional bar code printing 
pattems, the grooves 124 correspond to black stripes, 
while the lands 126 are the separating white spacing 

20 stripes. Using a system such as discussed in connection 
with Figure 4, the barcode-like data signal can be read- 
ily read as a laser beam sweeps across the passive tag 
120. 

[0036] To simplify printing of unique identifying tags, 

25 a tag system that supports conventional bar code print- 
ing with ink, laser, or other suitable printer can be ad- 
vantageous. As seen In Figure 6, a multilayer tag 130 
having a transparent printable cover layer 1 33 and a ret- 
roreflective substrate 132 (similar to that described In 

30 connection with Figure 5) can be used. Conventional 
printing systems can be used to print black stripes 134 
across transparent cover layer 133 to emulate conven- 
tional barcode printing (or any other suitable identifica- 
tion scheme) by selective obscuration of the retroreflec- 

35 tive substrate 132. Again using a system such as dis- 
cussed in connection with Figure 4, the bar code-like 
data signal can be readily read as a laser beam sweeps 
across the passive tag 120. reading the data signal in 
the pattem of retroreflected light signal from land area 

40 136 separated by minimal signal from black stripes 134. 
[0037J A tag system having both passive and active 
elements Is schematically illustrated in Figure 7. As 
seen in Figure 7, a multilayer tag 140 having a transpar- 
ent printable cover layer 143 and a retroreflective sub- 

45 strate 142 (similar to that described in connection with 
Figures 5 and 6) can be used. Conventional printing sys- 
tems can be used to print black stripes 145 across trans- 
parent cover layer 1 43 to emulate conventional bar code 
printing (or any other suitable identification scheme) by 

50 selective obscuration of the retroreflective substrate 
142. Using a system such as discussed In connection 
with Figure 4. the barcode-like data signal can be read- 
ily read as a laser beam sweeps across the passive tag 
1 40, reading the data signal in the pattem of retroreflect- 

55 ed light signal from land area 1 46 separated by minimal 
signal from black stripes 145, In addition, mutable infor- 
mation (e.g. shipping address, quantity of objects In 
tagged, opened box, etc.) can be read with the aid of an 
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active LCD layer 1 44. Using an LCD controller 1 49, dark 
regions 147 can be formed in active LCD layer 144 to 
obscure the underlying retroref iective substrate 1 42 vis- 
ible through transparent stripes 148. Such a tag advan- 
tageously allows use of preprinted identifying infomna- 
tion. while still allowing addition of locale or object spe- 
cific information in a low cost, low power tag. The LCD 
controller 1 49 can be powered by a small battery or pho- 
tovoltaic power source. 

[0038] In addition to their straightforward use as ob- 
ject identifiers, active or passive tags can be used as 
part of virtual control systems based on their detected 
relative or absolute position. For example, as seen in 
Figure 8, a virtual slider control system 1 50 can be con- 
structed from retroreflective tags 152, 154, and 156. Us- 
ing a tag positioning and identification system such as 
discussed in connection with Figures 1 and 4, the tags 
152 and 154 can be associated with a control system 
(e.g. a temperature controller, light level controller, au- 
dio level controller). Movement of a "slider bar 1 56" from 
Its Initial position at X=3 to X=7 {measured In relative 
distance units between tags 152 and 154), is detected 
by a non-imaging laser system or other suitable tracking 
system, and associated with required temperature, light 
level, audio or other indicated control changes. Similar- 
ly, a rotary virtual control system 1 60 can be constructed 
to use relative orientation of tags 1 62 and rotatable "dial 
164" as seen in conjunction with Figure 9. 
[0039] Such virtual control systems usable in conjunc- 
tion with tags as seen in Figures 8 and 9 and a tracking 
and positioning system as discussed in connection with 
Figure 1 advantageously do not require direct wire con- 
nections, expensive digital or analog electronics, and 
can be custom designed with appropriate colored or 
shaped material that is suitably tagged, or is Itself a tag. 
As those skilled in the art wlii appreciate, each identifi- 
cation number or sensed data value that is read 
(sensed) from the tag can be labeled as a "command", 
with a particular digital service or attribute being asso- 
ciated with each command. Although the wide variety of 
easily distinguishable commands (e.g. identification 
numbers) would alone provide a powerful virtual user 
Interface to a computer, the present invention further ex- 
tends the flexibility of the command based user interface 
by supporting computer control based on a multiple 
command input, with temporally synchronous (or over- 
lapping asynchronous) tuples of one or more com- 
mands (e.g. particular Identification numbers and 
sensed states) being read by the tag reader. Single and 
multiple commands can in turn be extended by partici- 
pation in a "sentence". A sentence is defined as a se- 
quence of one or more temporally disjoint commands or 
command tuples. The sentence level allows definition 
of an Input grammar by appropriate choice of command 
sequence, and corollary rules governing, for example, 
use of active verb-like commands (e.g. "go to", "zoom- 
In", "rotate"), naming noun-like commands (e.g. 
DOC1 .TXT, "yesterday's viewpoint" or other tag associ- 



ated document, object or command), or connectors (e. 
g. AND). 

[0040] To better illustrate operation of the present In- 
vention of virtual controls, consideran example scenario 

s wherein surface mountable physical artifacts (i.e. phys- 
ical Icons) are associated with virtual applications, doc- 
uments or objects, or digital services. In operation, a 
tagged object such as document has associated textual 
and electronic data Is physically associated by a user 

10 with an operator icon shaped as an arrow. The arrow 
shaped object supports two tags having unique identifi- 
cation signals, allowing the arrow direction to be distin- 
guished by the system. Placing the arrow with respect 
to the various tags causes modification of that associ- 

15 ated electronic data in response to physical association 
of the operator Icon (arrow) with a tagged object (e.g. 
object with embedded tag). For example, consider a sit- 
uation where tagged document Is positioned near an ob- 
ject symbolically representing a user. An operator icon 

20 symbolically configured as a pointing arrow can be po- 
sitioned to point from the document toward object. This 
association causes the database and tracking system 
of the system to electronically mall the document to the 
user. Reversal of the arrow so that the arrow points from 

25 the user symbol to the document can result in modifica- 
tion of document properties, Unking the user in the da- 
tabase to the document and automatically infomning the 
user of any updates, changes, or alterations to the doc- 
ument. 

30 

Claims 

1. A user operated virtual control system based on 
35 identification and spatial tracking of tags distributed 

in a room, the system comprising, 

a laser base station for scanning laser beams, 
multiple tags reactive to incident laser beams 

40 to provide a data signal, and 

a tag tracking system receiving input from the 
laser base station, the tag tracking system pro- 
viding a control signal in response to user de- 
fined location changes in at least one of the 

45 multiple tags. 

2. The system of claim 1 , wherein the tag tracking sys- 
tem detennines relative position of the multiple tags 
with respect to the laser base station. 

50 

3. The system of claim 1 , further comprising at least 
two laser base stations, and wherein the tag track- 
ing system detennines absolute position of the mul- 
tiple tags based on input from at least two laser base 

55 stations. 

4. The system of claim 1 , wherein the multiple tags are 
passive. 
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5. The system of claim 1 , wherein the mu Itlple tags are 
active, each tag having an internal power supply to 
power a data broadcast element. 

6. A method for user operated virtual control of sys- s 
terns, the method connprlsing the steps of, 

scanning laser beams throughout a room using 
a laser base station, 

detecting data signals produced by multiple 
tags reactive to Incident laser beams scanned 
throughout a room, and 
tracking positional changes of multiple tags, 
and providing a control signal in response to us- 
er defined location changes in at least one of 
the multiple tags. 

7. The method of claim 6, further comprising the step 
of determining relative position of the multiple tags 
with respect to the laser base station. 20 

8. The method of claim 6, further comprising the step 
of integrating positional infomnation from at least 
two laser base stations to detemnine absolute three 
dimensional position. 

9. The method of claim 6, wherein multiple tags have 
passive retroreflectors. 

10. The method of claim 6, wherein multiple tags are 30 
active, each tag having an internal power supply to 
power a data broadcast element producing detect- 
able data signals. 

35 
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FIG. 8 
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